Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot initiate cluster #1

Closed
vp223 opened this issue Jul 12, 2021 · 7 comments
Closed

Cannot initiate cluster #1

vp223 opened this issue Jul 12, 2021 · 7 comments
Assignees

Comments

@vp223
Copy link

vp223 commented Jul 12, 2021

Describe the bug
I put in my AWS credentials, then ran the command to create a cluster, but nothing happened. Returned nothing (no error and no output).

To Reproduce
Steps to reproduce the behavior:

  1. aws.cmd configure
  2. python emr_process.py -a create_cluster -c wittline

Desktop (please complete the following information):

  • Windows 10
  • Git Bash
  • AWS CLI 2
@Wittline Wittline self-assigned this Jul 12, 2021
@Wittline
Copy link
Owner

Wittline commented Jul 12, 2021

Hi @vp223,

I am covering your request, let me try to reproduce the error, I will back with you.

@vp223
Copy link
Author

vp223 commented Jul 12, 2021

Thank you!

@Wittline Wittline pinned this issue Jul 12, 2021
@Wittline
Copy link
Owner

Wittline commented Jul 19, 2021

Hi @vp223 I already tried and everything is working fine,
Could you please make sure you are in the correct location of the folder?

ramse@DESKTOP-K6K6E5A MINGW64 /c/pyspark-on-aws-emr/code python emr_process.py -a create_cluster -c wittline

@vp223
Copy link
Author

vp223 commented Jul 21, 2021

I removed the "CreateBucketConfiguration" argument from the "create_cluster" function in s3.py and it worked for me. I will have to see why this location constraint always impedes creation of a bucket for me, not in this tutorial, but all tutorials.

@vp223
Copy link
Author

vp223 commented Jul 21, 2021

I just read that the default location is us-east-1, so listing this argument will obstruct progress for anyone whose location is such. I should have properly searched comments about the issue before raising it. I apologise. Won't happen again.

@Wittline Wittline reopened this Jul 21, 2021
@Wittline
Copy link
Owner

Pending:

Try updating your configuration file cluster-ec2-spot-fleet.json with your region zones and subnets. remember always delete your resources created

@Wittline
Copy link
Owner

I will close this issue, the problem was related to the misunderstanding of the steps

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants