FlightAware- Senior Data Engineer (Remote)

Date Posted:2024-06-17Country:United States of AmericaLocation:HNC99: Field Office - NC Remote Location, Remote City, NC, 27601 USAPosition Role Type:RemoteAre you prepared to unlock additional value from the most complete dataset in aviation? FlightAware , part of the Connected Aviation Solutions unit of Collins Aerospace, has built the world's leading aviation software platform, processing over 180+ million incoming messages an hour from over 30,000 individual data feeds —2 terabytes a day and growing! We provide the best, most complete, and most accurate real-time flight-tracking service and are proud to have built a wide variety of successful products on this foundation that have become central to the aviation industry at large. As a Senior Data Engineer 2 at FlightAware you’ll provide technical guidance and expertise as we advance our data engineering capabilities. The Aviation Insight group in Engineering is responsible for delivering real-time and historical insights from our data . We do this through streaming data processing and fusion to generate our single source of truth, which we then use to train our predictive models . We have goals to improve our access to historical data, i.e. making it easily queryable, and improving our ETL jobs that support machine learning and reporting use-cases. In this role, you’ll lead technical projects in our data engineering effort, including platform improvements, stream processing applications, and historical/batch processing workflows . The ideal candidate will be able to quickly develop proofs-of-concept as well as transition systems to production while collaborating with our Operations team. This role requires creativity and innovation , and communication of new approaches to a technical audience will be important for success. As part of FlightAware Engineering, you’ll be part of a highly collaborative, ambitious, and future-reaching organization. We attract engineering leaders with a passion for aviation and data . Our team champions intellectual curiosity , openness, and industry-leading technical innovation. We invest in building excellent internal tooling and engineering support in order to create a productive and highly effective team that anticipates the future and leads by example. You’ll get to learn alongside talented senior engineers and share your own expertise. Regardless of role, we expect excellent interpersonal and communication skills across all hires at FlightAware. We look for candidates who will thrive here, meaning they demonstrate clear communication, embrace open feedback, trust their colleagues, and are driven to execute , deliver, and complete projects independently and efficiently. Learn more about FlightAware’s interview process here (https://flightaware.engineering/interviewing-at-flightaware-a-guide-to-joining-our-team-2/) . What You Will Do:

You will lead the efforts of the Predictive Technologies crew in redesigning ETL processes for preparing data for training machine learning models. This means designing the platform to support large batch ETL jobs joining diverse data sources and terabytes of data.

You will enable the business intelligence and data reports crews by transforming data to support visualizations and analytics products. This means syncing and transforming data into new data warehouses to optimize performance compared with the typical queries, involving multiple years of data.

You will lead efforts to transform our historical dataset. This means establishing standards for archiving data feeds, both realtime and historical, now stored as compressed TSV files into queryable Iceberg tables.

You will work with stakeholders and product owners to define technical roadmaps. This means you own the long-term roadmap for a new data platform, and identify projects with highest marginal ROI.

You will mentor others and support your peers' career growth. This means spreading your expertise across domains in FlightAware to increase our entire company’s collective expertise in data engineering.

What You Will Learn:

You will develop a deep understanding of aviation data and the insights that can be gained from them.

You will learn how FlightAware’s data products support customer facing applications to enable operational decisions.

You will gain exposure to machine learning systems making thousands of predictions per second.

You will experience how your work can make an entire company more efficient.

Qualifications You Must Have:

Typically requires a degree in Science, Technology, Engineering or Mathematics (STEM) unless prohibited by local laws/regulations and minimum 10 years prior relevant experience or an Advanced Degree in a related field and minimum 7 years of experience or in absence of a degree, 14 years of relevant experience.

Must be authorized to work in the U.S. without sponsorship now or in the future. RTX will not offer sponsorship for this position.

Demonstrated experience as a Lead or Senior Data Engineer/Scientist or Software Engineer or similar, engineering data pipeline development and deployment.

Experience with message queues and/or pub/sub systems, e.g. Kafka, Redis, RabbitMQ, etc.

Experience with Python, Docker, Kubernetes, and SQL/NoSQL databases.

Experience with streaming processing platforms, e.g. Spark, Flink, etc. and public cloud providers, particularly AWS.

Experience with tools like Debezium for CDC

Experience with the Databricks platform

Qualifications We Prefer:

Experience with Rust or Scala.

You are a private pilot, you are looking to pursue your private pilot license, or have a passion for aviation.

What We Offer:

Some of our competitive benefits package includes:

Medical, dental, and vision insurance

Three weeks of vacation for newly hired employees

Generous 401(k) plan that includes employer matching funds and separate employer retirement contribution, including a Lifetime Income Strategy option

Tuition reimbursement program

Student Loan Repayment Program

Life insurance and disability coverage

Optional coverages you can buy: pet insurance, home and auto insurance, additional life and accident insurance, critical illness insurance, group legal, ID theft protection

Birth, adoption, parental leave benefits

Ovia Health, fertility, and family planning

Adoption Assistance

Autism Benefit

Employee Assistance Plan, including up to 10 free counseling sessions

Healthy You Incentives, wellness rewards program

Doctor on Demand, virtual doctor visits

Bright Horizons, child and elder care services

Teladoc Medical Experts, second opinion program

And more! 

Learn More & Apply Now!

Diversity drives innovation; inclusion drives success . We believe a multitude of approaches and ideas enable us to deliver the best results for our workforce, workplace, and customers. We are committed to fostering a culture where all employees can share their passions and ideas so we can tackle the toughest challenges in our industry and pave new paths to limitless possibility.

#reempowerprogram

This role is also eligible for the Re-Empower Program. The Re-Empower Program helps support talented and committed professionals as they rebuild their capabilities, enhance leadership skills, and continue their professional journey. Over the course of the 14-week program, experienced professionals will gain paid, on-the-job experience, have an opportunity to participate in sessions with leadership, develop personalized plans for success and receive coaching to guide their return-to-work experience. Upon completion of the program, based on performance and contributions participants will be eligible for a career at RTX.

Minimum Program Qualifications:

Be on a career break of one or more year at time of application

Have prior experience in functional area of interest

Have interest in returning in either a full-time or part-time position

Connected Aviation Solutions:

Our Connected Aviation Solutions team provides advanced information management systems, products and services that enable the connected ecosystem by bringing together Collins’ unique breadth of aviation, surface transportation and critical infrastructure products with our smart digital solutions to help us enhance every aspect of the end-to-end travel experience. We help airlines, airports, business aircraft and rail operators turn data into value to streamline operations, increase efficiency and reduce cost, enhance the passenger experience and contribute to sustainable flight. By combining the best networks, connectivity and data/analytics solutions, we’re solving big problems for our customers and the world, while enhancing the security and connectivity of systems both on and off the aircraft, to help operators and passengers stay more connected and informed and create a more sustainable, efficient, reliable and enjoyable travel experience. Aviation connects the world. Our Connected Aviation Solutions team connects aviation. Sustainably. Seamlessly. Securely.

Please consider the following role type definitions as you apply for this role.

Remote: Employees who are working in Remote roles will work primarily offsite (from home). An employee may be expected to travel to the site location as needed.

This position is remote; however, if you live within a reasonable commute of a Collins site with other colleagues you interact with, your manager will discuss whether there is a degree of onsite presence associated with this role. The salary range for this role is 118,000 USD - 246,000 USD. The salary range provided is a good faith estimate representative of all experience levels. RTX considers several factors when extending an offer, including but not limited to, the role, function and associated responsibilities, a candidate’s work experience, location, education/training, and key skills.Hired applicants may be eligible for benefits, including but not limited to, medical, dental, vision, life insurance, short-term disability, long-term disability, 401(k) match, flexible spending accounts, flexible work schedules, employee assistance program, Employee Scholar Program, parental leave, paid time off, and holidays. Specific benefits are dependent upon the specific business unit as well as whether or not the position is covered by a collective-bargaining agreement.Hired applicants may be eligible for annual short-term and/or long-term incentive compensation programs depending on the level of the position and whether or not it is covered by a collective-bargaining agreement. Payments under these annual programs are not guaranteed and are dependent upon a variety of factors including, but not limited to, individual performance, business unit performance, and/or the company’s performance.This role is a U.S.-based role. If the successful candidate resides in a U.S. territory, the appropriate pay structure and benefits will apply.RTX anticipates the application window closing approximately 40 days from the date the notice was posted. However, factors such as candidate flow and business necessity may require RTX to shorten or extend the application window.RTX is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class. Privacy Policy and Terms:Click on this link (http://www.rtx.com/privacy/Job-Applicant-Privacy-Notice) to read the Policy and Terms Raytheon Technologies is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class.