每天从 CSV 文件更新 MySQL（存储过程中不允许加载数据）

Posted 2023-02-24

【中文标题】每天从 CSV 文件更新 MySQL（存储过程中不允许加载数据）

【英文标题】：Update MySQL from CSV file every day (load data is not allowed in stored procedures)

【发布时间】：2017-06-27 14:24:16

【问题描述】：

我在我的网站上工作（php 语言），我想每天用 csv 文件更新我的表格，所以我写了这个：

LOAD DATA LOCAL INFILE 'C:/wamp/www/mywebsite/data/m5.csv' 
INTO TABLE m4 
FIELDS TERMINATED BY "," 
LINES TERMINATED BY "\n"
IGNORE 1 LINES
(col1,col2,col3,col4,col5)

我已经在 PhpMyAdmin 中创建了一个事件，但是当我想验证我的事件时，我遇到了这个错误：

#1314 存储过程中不允许加载数据

如何使用 CSV 文件每天更新​​我的表格？

谢谢

【问题讨论】：

您的 CSV 包含所有数据库记录还是仅包含更新的记录？

每天我都会截断我的表格，我想在 csv 文件中插入新信息

您是否有兴趣使用 php 脚本而不是 PhpMyAdmin 事件来执行此操作？

是的！但是可以在我的 wamp serverur 中测试它吗？谢谢

【参考方案1】：

关于这个问题：Importing CSV data using PHP/mysql

您的问题的解决方案可能是这样的

<?php
$query = <<<eof
    LOAD DATA INFILE 'C:/wamp/www/mywebsite/data/m5.csv'
    INTO TABLE m4
    FIELDS TERMINATED BY ','
    OPTIONALLY ENCLOSED BY '"'
    LINES TERMINATED BY '\n'
    IGNORE 1 LINES
    (col1,col2,col3,col4,col5)
eof;

$db->query($query);
?>

但是，如果您对执行相同操作的 php 脚本感兴趣，可以试试这个

<?php
$dbhost =  "";
$dbname = "";
$dbusername = "";
$dbpassword = "";


$dbtable = "m4";
$fieldseparator = ",";
$lineseparator = "\n";
$csvfile = "C:/wamp/www/mywebsite/data/m5.csv";

/********************************/
/* Set this to 1 if your table have an auto_increment field.
/********************************/
$addauto = 0;
/********************************/
/* Would you like to save the mysqli queries in a file? If yes set $save to 1.
/* Permission on the file should be set to 777. Either upload a sample file through ftp and
/* change the permissions, or execute at the prompt: touch output.sql && chmod 777 output.sql
/********************************/
$save = 0;
$outputfile = "";


if(!file_exists($csvfile)) 
    echo "File not found. Make sure you specified the correct path.\n";
    exit;


$file = fopen($csvfile,"r");

if(!$file) 
    echo "Error opening data file.\n";
    exit;


$size = filesize($csvfile);

if(!$size) 
    echo "File is empty.\n";
    exit;


$csvcontent = fread($file,$size);

fclose($file);

$conn = mysqli_connect($dbhost, $dbusername, $dbpassword, $dbname) or die('Could not connect');

mysqli_set_charset($conn,"utf8");

$sqldel="DELETE FROM ".$dbtable;

$conn->query($sqldel);
$lines = 0;
$queries = "";
$linearray = array();

foreach(explode($lineseparator,$csvcontent) as $line) 

    $lines++;

    $line = trim($line," \t");

    $line = str_replace("\r","",$line);

    /************************************
    This line escapes the special character. remove it if entries are already escaped in the csv file
    ************************************/
    $line = str_replace("'","\'",$line);
    /*************************************/

    $linearray = explode($fieldseparator,$line);

    $linemysql = implode("','",$linearray);

    $linemysql = utf8_encode($linemysql);

    if($addauto)
        $query = "INSERT INTO $dbtable VALUES('','$linemysql');";
    else
        $query = "INSERT INTO $dbtable VALUES('$linemysql');";

    $queries .= $query . "\n";

    $res_i=$conn->query($query);



if($save) 

    if(!is_writable($outputfile)) 
        echo "File is not writable, check permissions.\n";
    

    else 
        $file2 = fopen($outputfile,"w");

        if(!$file2) 
            echo "Error writing to the output file.\n";
        
        else 
            fwrite($file2,$queries);
            fclose($file2);
        
    


?>