In an earlier lesson, we looked at how to redirect output from a command to a file using >. This is called output redirection, and you’ll be learning how to do that in more detail over the course of this lesson. 

In this lesson, you will discover how to redirect output from one command to an empty file, and redirect the output from the screen to files. You'll also learn about wildcard characters and escaping characters to have greater control of output when you use commands such as grep and echo.

In this lesson, we will also cover the concept of piping, how it is used, and why it is important. The basic idea of piping is cutting off the intermediate step of writing to a file and connecting the output of a command directly to the input of another command. Building effective data pipelines can greatly improve workflow efficiency on big data analysis and data science projects, so this is a key skill for data scientists to learn.

As you work through each concept, you will be given an opportunity to practice what you have learned so far. The terminal inside of this lesson includes answer checking so you can ensure that you've fully mastered each concept before learning the next concept.

Objectives

  • Learn to build a basic shell pipeline.
  • Learn to search files using grep.

Lesson Outline

1. Appending
2. Redirecting from a file
3. The grep command
4. Special characters
5. The star wildcard
6. Piping output
7. Chaining commands
8. Escaping characters
9. Takeaways