• Anna
    link
    fedilink
    24 days ago

    Check if a CSV exists and if it does rename to the filename_date.CSV and upload to hdfs

    • ☆ Yσɠƚԋσʂ ☆OP
      link
      fedilink
      34 days ago

      here’s what DeepSeek gave me for the following prompt: write a small bash script to check if a CSV exists and if it does rename to the filename_date.CSV and upload to hdfs, keep it simple

      #!/bin/bash
      
      # Check if filename argument is provided
      if [ $# -eq 0 ]; then
          echo "Usage: $0 <csv_filename>"
          exit 1
      fi
      
      CSV_FILE="$1"
      
      # Check if file exists
      if [ ! -f "$CSV_FILE" ]; then
          echo "Error: File $CSV_FILE not found!"
          exit 1
      fi
      
      # Generate new filename with date (YYYYMMDD format)
      DATE=$(date +%Y%m%d)
      NEW_FILENAME="${CSV_FILE%.*}_${DATE}.csv"
      
      # Rename the file
      mv "$CSV_FILE" "$NEW_FILENAME"
      
      # Upload to HDFS
      hdfs dfs -put "$NEW_FILENAME" /path/to/hdfs/directory/
      
      echo "Successfully processed: $NEW_FILENAME"
      
      • Anna
        link
        fedilink
        34 days ago

        OK at least it didn’t create functions for everything. ChatGPT had a function to kinit, to rename and to upload to hdfs. And each function had 2-3 line comments. I mean for a single command how can you put 3 lines of comments.

        • ☆ Yσɠƚԋσʂ ☆OP
          link
          fedilink
          34 days ago

          I’ve never touched ChatGPT out of principle, but everything I hear about it makes it sound like hot garbage.