Artificial Intelligence Jobs - Kafka Pipeline Engineer, 1565

at Leidos
Location Arlington, VA
Date Posted November 20, 2020
Category Default
Job Type Full-time



Job Description:

You have extreme curiosity: you ask why, you explore, you are familiar with latest and greatest open source tools, and always fascinated by what’s possible and what could be better. You like Machine Learning and Artificial Intelligence work and the thought of joining an elite team working on the cutting edge of innovation in Artificial Intelligence and Machine Learning, AIOps and Cyber AI excites you! 
Come work for Leidos in our Innovation Center building, maintaining and extending large streaming data architectures in the comfort of your own home as our latest Kafka Pipeline Engineer. We will only ask you to travel occasionally to places like Arlington, VA.  Collaborate and learn from the very best team of developers with deep experience in machine learning and artificial intelligence. 
Be responsible for designing, implementing, testing and deploying architectural components and code modules that bring AI and ML to high-impact programs and customers.  To achieve these goals, you will work in agile, collaborative, distributed teams throughout the project lifecycle.  You will support your team and stakeholders in estimating work, delivering the sprint backlog and minimizing tech debt while having fun doing the following.
Fun stuff on the job you will do: 
• Engineer optimal data architectures with Kafka as the message broker
• Size, configure and tune Kafka cluster deployments
• Design and develop kSQL and Spark Streaming modules
• Perform release and sprint planning
• Work on a distributed, high-paced, fast-moving and disciplined agile team
• Ensure functional and non-functional requirements are delivered

This is you:
• BS Degree in a technical field (Computer Science or related discipline like Engineering, or Mathematics), plus 2+ years relevant experience in software development, with Java or Python being a required language
• Must be able to obtain a secret security clearance
• Prior experience with Kafka 
• Prior experience with agile projects and agile development 
• Integrating Kafka with other components, tools
• Experience with at least one of these data formats: Avro, Protobuf, Parquet
• Experience with schema formats, storage, evolution and design
• Prior experience with streaming data architectures and modern development approaches (serverless, containerization, cloud, continuous delivery, micro-services, event based applications)
• Strong software developer and/or data engineering experience
•  Demonstrated ability to learn quickly and to independently use available resources to close knowledge gaps
• Strong oral and written communication and interpersonal skills

You will wow us if you have these skills:
• Prior development experience with sql and no-sql databases such as Elastic Search, Flink, Storm
• Development experience with Scala
• Prior product owner experience or education/training
• Prior experience with Spark Streaming or Spark
• Prior experience with Confluent Kafka, kSQL

External Referral Eligible

External Referral Bonus:


Potential for Telework:

Yes, 100%

Clearance Level Required:



Yes, 10% of the time

Scheduled Weekly Hours:




Requisition Category:


Job Family:

Data Scientist

Leidos is a Fortune 500® information technology, engineering, and science solutions and services leader working to solve the world’s toughest challenges in the defense, intelligence, homeland security, civil, and health markets. The company’s 38,000 employees support vital missions for government and commercial customers. Headquartered in Reston, Va., Leidos reported annual revenues of approximately $11.09 billion for the fiscal year ended January 3, 2020. For more information, visit

Pay and benefits are fundamental to any career decision. That's why we craft compensation packages that reflect the importance of the work we do for our customers. Employment benefits include competitive compensation, Health and Wellness programs, Income Protection, Paid Leave and Retirement. More details are available here.

Leidos will never ask you to provide payment-related information at any part of the employment application process. And Leidos will communicate with you only through emails that are sent from a email address. If you receive an email purporting to be from Leidos that asks for payment-related information or any other personal information, please report the email to [Click Here to Email Your Resumé].

All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law. Leidos will also consider for employment qualified applicants with criminal histories consistent with relevant laws.

Drop files here browse files ...