☆ Yσɠƚԋσʂ ☆

  • 428 Posts
  • 353 Comments
Joined 5 年前
cake
Cake day: 2020年1月18日

help-circle


























  • here’s what DeepSeek gave me for the following prompt: write a small bash script to check if a CSV exists and if it does rename to the filename_date.CSV and upload to hdfs, keep it simple

    #!/bin/bash
    
    # Check if filename argument is provided
    if [ $# -eq 0 ]; then
        echo "Usage: $0 <csv_filename>"
        exit 1
    fi
    
    CSV_FILE="$1"
    
    # Check if file exists
    if [ ! -f "$CSV_FILE" ]; then
        echo "Error: File $CSV_FILE not found!"
        exit 1
    fi
    
    # Generate new filename with date (YYYYMMDD format)
    DATE=$(date +%Y%m%d)
    NEW_FILENAME="${CSV_FILE%.*}_${DATE}.csv"
    
    # Rename the file
    mv "$CSV_FILE" "$NEW_FILENAME"
    
    # Upload to HDFS
    hdfs dfs -put "$NEW_FILENAME" /path/to/hdfs/directory/
    
    echo "Successfully processed: $NEW_FILENAME"