Vacancy expired!
Business Intelligence/Data Visualization EngineerPartially OnsiteAbout the Job
- Duration: Long term renewable contract
- Location: Greenville, SC
- Pay rate: Hourly, depending on experience
- Job ID: 3952
- This position is with the advanced data analytics team. They are responsible for all of the data in the data lake which is moved into AWS. They are responsible for the ingestion work and all the transformations that happen with the data sets to make them consumable for use cases.
- Implements and enhances complex data processing pipelines with a focus on collecting, parsing, cleaning, managing, and analyzing large data sets that produce valuable business insights and discoveries.
- Determines the required infrastructure, services, and software required to build advanced data ingestion & transformation pipelines and solutions in the cloud.
- Assists data scientists and data analysts with data preparation, exploration, and analysis activities.
- Applies problem-solving experience and knowledge of advanced algorithms to build high-performance, parallel, and distributed solutions.
- Performs code and solution review activities and recommends enhancements that improve efficiency, performance, stability, and decreased support costs.
- Applies the latest DevOps and Agile methodologies to improve delivery time.
- Works with SCRUM teams in daily stand-up, providing progress updates frequently.
- Supports application, including incident and problem management.
- Performs debugging and triage of incidents or problems and deployment of fix to restore services.
- Documents requirements and configurations and clarifies ambiguous specs.
- Performs other duties as assigned by management.
- This role critical requires Python and understanding of Terraform and Glue and Athena within AWS.
- BA/BS Degree in Business, Computer Science, or Electrical Engineering preferred or the equivalent of 4 years professional IT-related experience. MS degree (preferred).
- 3+ years of enterprise software engineering experience with object-oriented design, coding, and testing patterns, as well as, experience in engineering (commercial or open-source) software platforms and large-scale data infrastructure solutions.
- 3+ years of software engineering and architecture experience within a cloud environment (Azure, AWS).
- 3+ years of enterprise data engineering experience within any "Big Data " environment (preferred).
- 3+ years of software development experience using Python.
- 2+ years of experience working in an Agile environment (Scrum, Lean, or Kanban).
- 3+ years of experience working in large-scale data integration and analytics projects, including using cloud (e.g. AWS Redshift, S3, EC2, Glue, Kinesis, EMR) and data-orchestration (e.g. Oozie, Apache Airflow) technologies
- 3+ years of experience in implementing distributed data processing pipelines using Apache Spark
- 3+ years of experience in designing relational/NoSQL databases and data warehouse solutions
- 2+ years of experience in writing and optimizing SQL queries in a business environment with large-scale, complex datasets
- 2+ years of Unix/Linux operating system knowledge (including shell programming).
- 1+ years of experience in automation/configuration management tools such as Terraform, Puppet, or Chef.
- 1+ years of experience in container development and management using Docker.
- Languages: SQL, Python , Spark
- Basic knowledge of continuous integration tools (e.g. Jenkins).Basic knowledge of machine learning algorithms and data visualization tools such as Microsoft Power BI and Tableau.
- Experience with S3, Python, and understanding of Terraform and Glue and Athena within AWS is preferred.
- Experience with Spark, Hadoop, Linux would be preferred.
- Certifications/Skills: AWS/Azure cloud provider training/certifications (preferred)
- Python is a must-have. AWS experience is strongly preferred.
- Development experience is also a must.
- Paid Holidays/Paid Time Off (PTO)
- Medical/Dental Insurance
- Vision Insurance
- Short Term/Long Term Disability
- Life Insurance
- 401 (K)
- ID: #22213751
- State: South Carolina Greer 29651 Greer USA
- City: Greer
- Salary: BASED ON EXPERIENCE
- Job type: Permanent
- Showed: 2021-11-05
- Deadline: 2022-01-02
- Category: Et cetera